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Abstract. Mean-payoff expressions are the closure of mean-payoff ob- 
jectives under the algebraic operations of min, max and sum. This class 
of objectives was introduced in [T], and the decidability of the verifica- 
tion problem (that is, one-player games) for such objective was estab- 
lished. In this paper, we study, for the first time, synthesis problems 
for mean-payoff expression objectives, and the most relevant problem is 
O ■ the synthesis of a finite- memory controller. This problem is captured by 

D _ two-player mean-payoff expression games on graph, where the objective 

^0 ■ of one player is to maximize the value of the expression, the objective 

of the other player is to minimize the value, and player f is restricted 
to finite-memory strategies. Our main contribution is an effective algo- 
rithm that computes the optimal value that player 1 can achieve by a 
finite-memory strategy. (More accurately, the algorithm computes the 
least upper bound on the achievable values.) 

1 Introduction 

The algorithmic theory of infinite games on graphs is a powerful and flexible 
framework for the design of reactive systems. In games played on graphs, a pebble 
is placed on an initial vertex, and in every round, a player moves the pebble to a 
successor vertex. The vertices are partitioned into player-1 and player- 2 vertices, 
and in every round, the player who owns the vertex in which the pebble is located, 
advance the pebble into an adjacent vertex. The process of choosing next vertex 
for the pebble is repeated forever, and the outcome of such infinite process is a 
play. 

Traditionally, in the framework of verification and synthesis, games on graphs 
have been studied with qualitative objectives such as reachability, safety and ir- 
regular conditions. Recently, there is an emerging interest in games with quan- 
titative objectives; in these games, player 1 wishes to maximize the value of the 
play, and the objective of player 2 is to minimize that value. 

The classical quantitative objective is the mean-payoff objective. In this ob- 
jective, every transition in the graph has a weight, and the mean-payoff of a 
play is the long-run average weight of the play until round n, as n goes to in- 
finity. With mean-payoff objectives we can express quantitative properties such 
as average response time of an arbiter, or average power consumption of a ma- 
chine. However, the mean-payoff objective is not robust, as it is not closed under 
the algebraic operations of max, min and sum [T] . For this reason, Chaterjee et 



al. PQ introduced the class of mean-payoff expressions objectives, which is the 
closure of mean-payoff objectives under the operations min, max and sum. They 
proved that the verification problem is decidable for mean-payoff expression 
specifications, and as a result, the class of mean-payoff expressions is the first 
(and currently the only) known natural class of quantitative objectives that is 
both robust and has an effective algorithm for the verification problem. However, 
they did not investigate the corresponding synthesis problem, and no synthesis 
algorithms were known. 

In this work, we study for the first time the synthesis problem for mean- 
payoff expression objectives. The synthesis task for quantitative objectives is to 
find a player-I strategy that is optimal with respect to the objective. That is, 
to find a strategy such that the minimal value of all plays according to this 
strategy is maximal. Since we are usually interested in synthesis of hardware 
mechanisms, the most relevant synthesis task is to find an optimal finite-memory 
player-f strategy. However, for mean-payoff expression objectives, an optimal 
finite-memory strategy may not exists, even for a one-player game. For this 
reason, we concentrate on the problem of finding the least upper bound for the 
optimal value that player 1 can achieve by a finite-memory strategy. Our main 
contribution is an effective algorithm that computes this value. We note that once 
this value is computed, one can compute for any e > an e-optimal strategy 
by enumerating all player-1 finite-memory strategies, and solve the verification 
problem for the one-player game that is induced by this strategy (note that this 
process is guaranteed to halt). 

For reasons of convenience, in this paper, we switch the roles of the players, 
and assume that the objective of player 1 is to minimize the value of the plays (by 
a finite memory strategy). This can be done w.l.o.g since mean-payoff expressions 
are closed under numerical complement, that is, if E is an expression, then there 
exists an expression that is equivalent to — E. 

In the most abstract level, we solve a two-player game by finding a finite- 
memory strategy that induces the worse one-player (player-2) game graph in 
terms of threshold for which player 2 can win (in the one- player game). To be 
more concrete, we obtain a solution in four steps (described in Sections EH© ■ 
In the first step, we give a finite description for the sets of cycles in one-player 
games that are induces by player-1 finite-memory strategies. In the second step, 
we recall that in a one-player mean-payoff expression game, the maximal value 
of the play depends only in the set of cycles in the graph, and we characterize 
the satisfactory sets of cycles for every threshold. In the third step, we combine 
the results of the first two steps, and solve games in which player 1 objective 
is to have a finite-memory strategy such that the cycles in the induced one- 
player game graph violates the mean-payoff expression (with respect to a given 
threshold). In the fourth and last step, we use the results of step three, and 
obtain our main result. 



2 Preliminaries 

Multidimensional weighted graphs. A multidimensional weighted graph is 
a tuple G = (S,T,w : T — >■ Q fe ), where S is the set of vertices, T is the set 
of transitions, and w is a multidimensional weight function. The weight vector 
of a finite path tt = tit 2 ■ ■ - t n is denoted by w(ir) = Ym=i w ( 7T )^ an d we de- 
note by Wi(n) the projection of the weight vector to dimension i. We denote 
Avg(ir) = -^p, and Avg^n) is the projection of Avg(n) to dimension i. For 

an infinite path 7r = tit2 ... we denote LimlnfAvg j(7r) = lim infn_5.ee ^ J=1 J"'^ :l ^ 
and LimSupAvg^-w) = limsup-^p- ^" J=1 J"'^ J ' > . 

Games on graph. A game graph is a directed graph G = (S = S1US2, So, T, w), 
where S is the set of vertices; Si are player i vertices; sq is the initial vertex; 
T C S x S is the set of edges; and w : T — > Q fc is a multidimensional weight 
function. 

A ptej/ is an infinite path in the graph that begins in sq. The 2fc-dimensional 
mean-payoff vector of a play 7r = so^is 1-2 • • • s n t n ... is defined as 

MP(tt) — (LimlnfAvg 1 (ir) , . . . , LimlnfAvg k (n) , LimSupAvg 1 (tt) , . . . , LimSupAvg k (w)) 

Strategies A strategy is a recipe for the extension of a finite path. A player-i 
strategy is a function <r : 5* Si — > 5, such that for every finite path 7r that ends 
in vertex s we have (s, cr(7r)) G T. A strategy has /mite memory if it can be 
implemented by a Moore machine (M, mo, a„, a u ), where M is a finite set of 
memory states, m is the initial memory state, a u : M x S — > M is the update 
function, and a„ : M x 5, -> S is the next vertex function. If a play prefix is 
in state Si and memory state M, then the strategy choice for the next vertex is 
s = a n (M, Si) and the memory is updated to a u (M, Si). 

We denote the set of all player- 1 finite memory strategies by TM.. 
Game graph according to a finite-memory strategy For a game graph 
G = (S = SiL)S2,T, w) and a player-I finite-memory strategy a — (M, mo, a u ,a n ), 
we denote the game graph according to strategy a by G" 7 , and we define it as 
following: 

— The vertices of G a are the Cartesian product S x M; player-i vertices are 
Si x M; and the initial vertex of G a is (s 0} m n ). 

— For a player-1 vertex (s, m), the only successor vertex is (a n (s, m),a u (s 7 to)). 
For a player-2 vertex (s,m) the set of successor vertices is {(q, n) \ (s,q) e 
T and a u (s, m) = n}. 

Note that the out-degree of all player-I vertices is one, and thus G a is a one- 
player game graph. 

Mean-payoff expression objectives Given a fc-dimensional game graph, a 
mean-payoff expression is defined by the following grammar rule: 

E = LimInfAvg 1 | •• • | LimlnfAvg k \ LimSupAvg 1 | •• • | LimSupAvg k \ max(E,E) \ mui(E y E) \ E+E 



The value of a play tt according to an expression E is denote by E(n) it is defined 

as 



— E(tt) = LimlnfAvg^ir) (resp. E(tt) = LimSupAvg^it)) if E — LimInfAvg i 
(E = LimSupAvgj). 

— E(tt) — op(i?i(7r), E 2 (n)) if E = op(Ei,E 2 ), for op G {max, min, +}. 

Values of strategies and games We note that a tuple (a, r) of player 1 and 
player strategies (respectively) uniquely defines a play "K a ^ r in a given graph. For 
a game graph G, mean-payoff expression E and a tuple of strategies (c, r) we 
denote Val atT — E(Tr ayT ). Recall that TM. is set of all playcr-1 finite-memory 
strategies and we denote (in this paragraph only) by B the set of all player-2 
strategies. The worst case value of a player-1 strategy r is denoted by Val™ orst = 
inf T6 £ Val a T. The best case value of a player-1 strategy r is denoted by Val b f st — 
sup reB Val a ^. 

The maximal value of a game is defined as max^^ = sup a€ jr M Val™ orst , and 
the minimal value of a game is defined as ming^ = ird ae jr^4 Val^ est . Intuitively, 
the maximal (resp. minimal) value of a game is the maximal (minimal) value 
that player 1 can ensure by a finite-memory strategy. We note that since the 
class of mean-payoff expressions is closed under numerical complement pQ , there 
is a reduction from the computation of the maximal values to the computation 
of minimal values (and vice- versa), due to the fact that maxp^ = minc_£. 

Quantitative and qualitative analysis For a given game graph, expression, 
and a rational threshold r £ Q: The quantitative analysis task is to compute the 
maximal value of the game. The qualitative analysis task is to decide whether 
there is a player-1 finite-memory strategy a for which Val™ orst > r. That is, 
whether player 1 can assure that a value of at least r for the expression. 

Qualitative games and winning strategies. A qualitative game is a game 
on graph equipped with a winning condition W C T u . A play n £ T u is winning 
for player 1 if tt £ W , and a strategy a is a player-1 winning strategy if for every 
player-2 strategy r we have it a%T £ W. 

3 The Linear Span Multidimensional Mean-Payoff Games 

For two vectors u — (wi, . . . , itfc), v = {v\, . . . , Vf.) £ we say that v < u if 
Vi < Ui for every i £ {l,...,fc}. For a set S C R fc , we define DC(S) to be 
the downward closure of S. Formally, DC(S) = {v £ R fc | 3u £ S s.t v < u}. 
For a finite set of vectors V = {v\,V2, ■ ■ ■ ,v n } £ R k , we denote SPAN(V) = 
{J2"=i a i v i I Si=i a i = 1 an d a i) ■•■! a n > 0}, and we denote the downward 
closure of SPAN(V) by DGSPAJV(V). 

A linear span multidimensional mean-payoff game (in short, LSMMP game) 
is played on a fc-dimensional weighted graph, and every infinite play p has 
a fc-dimensional lim-inf mean-payoff vector MP (p). The winning objective for 
player 1 is given by a set of vectors V C R fc , and player 1 wins in play p if 
MP Co) € DCSPAN{V). Hence, a LSMMP is a tuple (G,s ,F), where G is a 
multidimensional weighted graph, Sq is the initial state, and V is a set of vectors. 

The motivation for us to investigate LSMMP games is due to the next lemma. 



Lemma 1 Let (G, sq, V) be a LSMMP game, then player 1 has a finite-memory 
winning strategy if and only if there exists a player- 1 finite-memory strategy a 
such that the average weight of any reachable simple cycle in G a is in DCSPAN (V). 

Proof. In order to prove the direction from left to right, let us assume that 
player 1 has a finite-memory winning strategy a for the LSMMP game (G, sq, V). 
Towards contradiction, let us assume that in G CT there is a reachable simple 
cycle G with Avg(C) £ DCSPAN{V). Let re be a path to a vertex in the 
cycle G, then the path reo(G)" is an infinite path that is consistent with a and 
MP(re (G)") = Avg(C) $ DCSPAN{V), which contradicts the assumption that 
a is a winning strategy for the LSMMP game. 

The intuition for the proof of the converse direction is simple. For a given 
graph G, we can decomposed any path to a prefix with length at most |G|, a 
set of simple cycles, and a suffix of length at most |G|; and the lim-inf mean- 
payoff of an infinite path is a convex combination of the simple cycles it visits. 
Hence, if for a finite strategy a, we get that all the weights of the reachable 
cycles in G 7 are in DCSPAN (V), then for every path consistent with a we have 
MP(tt) £ DCSPAN{V). 

To formally prove the above intuition, we assume, towards a contradiction, 
that there is a path re in G CT for which MP (re) = u <£ DCSPAN (V), and we denote 
by 5 the (Euclidean) distance between u and DCSPAN (V). By definition, for 
every e > 0, there exist infinitely many prefixes of re, such that the distance 
between the average weight vector of any such prefix and u is at most e. In 
particular, for e = we get that there exists a finite prefix reo, with length at 

least 2 I ' w , and the distance between ^^(reo) and u is at most f . We decompose 
the path reo to a prefix p\ a set of simple cycles C\, . . . , C n and a suffix pi such 
that (i) the length of p\ and pi is at most |G|; and (ii) the cycle Ci occurs 
m 4 times in the path re . We get that Avg(w ) = M(p ' 1+ "' wl | f j" = '°"" 1Ci) ; and 
since the weights of p\ are p2 at most \G\W in every dimension^, we get that 

Ava(nn) < 2|G|ty + E? = i m t w(C t ) < (2\G\W,2\G\W,...,2\G\W) J27 =1 m z Avg(C t ) g . 

I To I > 21SE j we get that the distance between Avg {ttq) and ^ i =J-,"'^ g ^ C ''' ) 

(which is in DCSPAN (V)) is at most v^e < §■ Finally, we get that the distance 
between u and Avg(irtf) is at most e < | and the distance between j4v^(reo) and 
DCSPAN (V) is less than |, which contradicts the assumption that the distance 
between u and L>G5"Pyl#(y) is 5. □ 

Given a game graph, we say that a set of vectors V is feasible if player 1 
has a finite-memory winning strategy for the corresponding LSMMP game. In 
this section, we wish to characterize, for a given game graph, the feasible sets of 
vectors. 

The next lemma suggests that it is enough to characterize the sets of vectors 
that are feasible when player 2 is restricted to a memoryless strategy. 



1 where W is the maximal weight in the graph, in absolute value 



Lemma 2 For any LSMMP game (G, sq, V), player 1 has a finite-memory win- 
ning strategy in the game if and only if against every player-2 memoryless 
strategy t, player 1 has a finite-memory winning strategy in the (one-player) 
LSMMP {G T ,s ,V). 

Proof. The direction from left to right is trivial. Our proof for the converse 
direction is inspired by [2], and the key intuition of the proof, is the following. 
Let s be a player-2 vertex, with two out-edges t\ and £2. Suppose that player 2 
cannot win by using only one of the edges. Then player 1 can combine the two 
winning strategies of the games on G — {t{\ and G — {£2}, and he can obtain a 
finite-memory strategy er, such that the simple cycles in G a are composition of 
the cycles from the two winning strategies, and hence, a is a winning strategy 
for G. (We note that we cannot use directly the result of [2] for two reasons: 
(i) player 1 is restricted to finite-memory strategies; and (ii) the LSMMP game 
winning objective is not a member of the class of the so called convex winning 
objectives.) 

In order to formally prove the key intuition we claim that player 2 has a 
winning strategy in the LSMMP game only if it has a memoryless winning 
strategy, and we prove the claim by induction on the number of player-2 vertices 
with out-degree greater then one. The base case, where all of player-2 vertices 
have out-degree one, is trivial. For the inductive step, let us assume that there is 
a player-2 vertex s with out-edges t\ and £2 (if there is no such vertex, then we 
are in the base case). For i = 1,2, let Gi be G — {t{\. If player-2 has a winning 
strategy in either (Gi, so, V) or (G2, so, V), then by the induction hypothesis, he 
has a memoryless winning strategy, and surely this is also a memoryless winning 
strategy for (G, So,V), and the claim follows. 

Otherwise, we complete the proof by claiming that player 2 does not have 
a winning strategy in (G, Sq,V). Indeed, for i = 1, 2, let Oi be a finite- memory 
player-1 winning strategy in (Gi, sq,V), If in o\ (resp., 02), the vertex s is 
unreachable then it is surely a winning strategy also for (G, sq,V). Otherwise, 
o~ 1 induces a finite-memory winning strategy also for the game (G, s, V) (that 
is, a game that starts in s and not in sq), and we denote this strategy by erf. 
we construct a winning strategy a in the following way. The memory structure 
of a is a tuple (Mi, M2, {1,2}) where intuitively Mi is the memory structure of 
erf , M2 is the memory structure of a 2 , and the third value in the tuple indicates 
if we are playing according to erf or 172 • At the beginning of a play, er decides 
according to o~2 (and updates M2 accordingly) . If a decides according to 02 and 
edge £1 is visited, then a decides according to erf (and updates Mi accordingly), 
until edge £2 is visited, and then er again decides according to 02 , and so on. We 
note that er is a finite-memory strategy, and that any simple cycle in G a is a 
composition of simple cycles from G^ 1 and GJp • 

We now show that er is a winning strategy. By Lemma [TJ it is enough to show 
that the weights of all the simple cycles in G a are in DCSPAN(V). The latter 
holds, since every cycle in G a is a composition of simple cycles from G^ 1 and 
G2 2 , and since erf and er 2 are winning strategies (in Gi and G2 respectively), 



then the weights of their cycles are in DCSPAN(V); and thus, the average weight 
of any cycle that is a composition of those cycles is also in DCSPAN(V). 

To conclude, we get that player 2 is the winner if and only if it has a memo- 
ryless winning strategy, and the proof of Lemma [2] follows. □ 

In a one-player game graph, we say that a vector v e R k is achievable, if there 
exists a player- 1 finite-memory strategy that assures lim-inf mean-payoff vector 
v. We note that in a one-player game, player 1 can win DCSPAN (V) if and only if 
there is an achievable vector v € DCSPAN(V). Hence, if for a given game graph 
G, we have that T\ and Ti are the only possible player-2 memoryless strategies; 
and for t\ the achievable vectors are {1*1,^2}; and for t-i the achievable vectors 
are {y\,v-i\\ then by Lemma we get that the only four possible feasible sets 
in an LSMMP game over G are {ui, Vj} for i.j — 1, 2. In the general case, there 
may be only finitely many player-2 memoryless strategies t±, . . . , r m ; however, 
against strategy n, the set of achievable vectors Vi might be infinite. The next 
lemma describes the feasible sets, in terms of achievable vectors, for the general 
case. 

Lemma 3 Given game graph (G, sq), let t±, . . . ,r„ be the only possible player- 
2 memoryless strategies in G, and let Vi be the achievable vectors for (G Ti ,so); 
Then a set of vectors U is feasible (in (G, sq) ) if and only if there exists k vectors 
vi G Vi, . . . , v k G V„ such that DCSPAN (U) D DCSPAN ({vi, v n }). 

Proof. We first prove the direction from right to left. For this purpose we assume 
that there exists Vi € V, for every i £ {1, . . . , n}; and we claim that player 1 is 
the winner of the LSMMP game (G, sq, {i>i, . . . , v n }). Indeed, by Lemma [21 it 
is enough to show that player 1 is the winner against any player-2 memoryless 
strategy Tj. By definition of Vi, we get that against player-2 strategy Ti, player 1 
can achieve lim-inf mean-payoff Vi (and clearly Vi G DCSPAN ({vi, . . . ,v n })), 
and thus player 1 is the winner, and the set {vi,...,v n } is feasible. Since 
DCSPAN(U) D DCSPAN '({«!,...,«„}), it trivially follows that U is feasible 
as well, and we completed the proof for the direction from right to left. 

For the converse direction, let us assume that U is feasible, and let a be 
player-1 strategy that wins (G, s , U). Let be the (only) lim-inf mean-payoff 
vector for the (one) play that is consistent with both a and Tj. By defini- 
tion, r t G V u and r % G DCSPAN(U), and therefore DCSPAN ({r u ... ,r n }) C 
DCSPAN (U), and by choosing Vi = ri we complete the proof. □ 

In light of Lemma [3] and Lemma [2J it is enough to obtain a characterization 
of achievable vectors in a one-player game. For this purpose, we present the next 
definitions. 

When a graph is given, we say that a set of cycles C = {C\, C<i, . . . , C n } is a 
set of connected cycles if there exists a path in G such that its edges are exactly 
the edges that occur in C\, . . . , C n . Given an initial vertex, we say that C is a 
reachable set if all the cycles in C are reachable from the initial vertex. A set 
of cycles is a reachable connected simple cycles if it is reachable, connected and 
contains only simple cycles. We denote the set of all sets of simple connected 



and reachable cycles by SCR(G, s ). For a set of cycles C = {C\, C2, • ■ • , C„} e 
SCR(G, s ), we define the relative interior rational span of C as 

n n 

relRatSPAN(C) = otiAvg(Ci) | ^ cti = 1 and ax, . . . , a n e Q ++ } 
i=l i=l 

and we similarly define 

n n 

relSPAN(C) = (^onAvg{d) | ^ a, = 1 and a u . . . , a n e 

i=l i=l 

The next lemma characterize the set of achievable vectors in a one-player game. 

Lemma 4 For a grap/i (G,s n ), the set of achievable vectors is 

(J relRatSPAN{C) 

CeSCR(G,s ) 

Proof. The proof is straight forward. Every finite-memory strategy (in a one- 
player game graph) is an ultimately periodic infinite path ir = n (ni) u , such 
that iv 1 is a cyclic path and the mean-payoff vector of tt is Avg{~K\). A cyclic 
path is a composition of connected simple cycles C\, . . . ,C n , such that cycle 
Ci occurs rrii times in the path, and the average weight of the cyclic path is 
J2i=i m t w(c t ) a _ _ \ c i\ m i we g e ^ ^hat average weight is 

n 

^2aiAvg(d) 

i=l 

We note that by definition, a*i is a positive rational, and E"=i = 1. Hence the 
mean-payoff vector of any ultimately periodic path is in {JcescR(G s ) relRatSPAN (C). 

Conversely, for any vector v € [JceSCRfG s ) re lR a tSPAN "(C) , we have that 
for some positive rationals a\, . . . , a n , v — E"=i a iAvg(Ci). Let q\,...,q n and 

p be natural numbers for which on = ^, and we denote ZZ" = | Ci | - j C2 1 \C n \. 

Then by choosing rrij = p ^ a f , we get that 



and since Ei=i «i, we get that 



aiAvg(Ci) 

i=l 



Hence, for every vector in relRatSPAN {C) there exists an ultimately periodic 
path with a corresponding weight vector. □ 



By combining Lemmas 12131 and 2] we immediately get the next proposition 



Proposition 1 Given a game graph (G, sq), a set of vectors U is feasible if and 
only if there exists a set of vectors V — {v\ 1 . . . , v n } such that (i) DCSPAN(U) D 
DCSPAN (V); and (ii) t%, . . . , r n are the only possible player-2 memoryless strate- 
gies and for every vector Vi there exists a reachable connected simple cycles set 
Ci in (G Ti , so) such that Vi G relRatSPAN (Cj) . 

4 Properties of One-Player Mean-Payoff Expressions 
Games 

In this section, we present key properties of one-player mean-payoff expressions 
games (with arbitrary strategies). We note that the results in this section are 
derived from [TJ[3] in a straight forward manner. 

For an expression E and a game graph (G, sq), we say that a threshold v £ R 
is feasible if there exists a strategy (that is, an infinite path) that achieves a value 
of at least v for the expression E. We will show how to characterize the range 
of feasible thresholds, and for that purpose we bring the next definitions and 
lemmas. 

We say that an expression is max-free if the max operator does not occur in 
the expression. The next lemma implies that we may consider only expressions 
with the form of E — max(i5i, . . . ,E n ), where Ei is a max-free expression, for 
i = 1, . . . ,n. 

Lemma 5 For any game graph and expression E, there is an expression F = 
(Fi, . . . ,F n ) such that (i) F is equivalent to E; (ii) every Fi is a max-free ex- 
pression; and (in) F is computable from E (and the game graph). 

Proof. The proof is by induction on the number of operators in the expression, 
which we denote by to. If m = 0, then E is a max-free expression and F = 
ma,x(E, E) is the desirable expression. If to > 1, then there are two expressions 
Ei and E%, both with at most m— 1 operators, such that E = op(Ei, E2), 
for some op G {max, min, sum}. By the induction hypothesis there exists F\ = 
max(_ffi, . . . , H n ) (resp., F2 — max(Gi, . . . , G„)) that is a maximum of max- 
free expressions, and E\ (E2) is equivalent to F\ (F2); and we get that F = 
max(ffi, . . . , H n , Gi, . . . , G n ) is the desirable expression. □ 

We recall the max-free constraints, which we presented in [3], and which describe 
the feasible thresholds for a max-free expression. 

Definition 1 (Max-free constraints) Let G be a strongly- connected k- dimensional 
game graph, and we denote by C the set of simple cycles of G. Let E be a max- 
free expression such that the first j dimensions of G occur in E as lim-inf ( and 
the others as lim-sup). We define a variable X l c for every simple cycle c and 
index i G {j + 1, . . . , k}, and we define a vector of variables r — (ri, . . . , r2fe). 
The the max-free constraints for threshold vgQ are 

^2 x l A vg m (c) > r m for every i G {j + 1, . . . , k} and m G {1, . . .,j,i} (1) 

cSC 



^2 X c = 1 f or every * G {j + 1, . . . , fc} 

cSC 



(2) 



-^c ^ / or every * G {j ' + 1, • • • , fc} c e C 



(3) 



M B xr>(0,...,0,f) T 



(4) 



where Me is a matrix that is independent of the graph, and computable from 
E. It was proved in [3] that a threshold v is feasible if and only if the corre- 
sponding max- free constraints are feasible. The max- free constraints shed light 
on a key property of mean-payoff expressions. Let us denote for a strongly con- 
nected graph G, the set of vectors that contains the average weight vectors of 
all the simple cycles in the graph, by Avg(G); and let us denote DCSPAN(G) = 



Lemma 6 Let E be a mean-payoff expression over k dimensions, and let G be 
a strongly connected k- dimensional graph. If the maximal feasible threshold of E 
in graph G is v , then for every strongly connected k-dimensional graph H with 
DCSPAN(H) C DCSPAN{G) we have that the maximal feasible threshold of E 
in graph H is at most v . 

Proof. Since we assume that E = max(i?i, . . . , E n ), where Ei is a max-free ex- 
pression, it is enough to prove that if the threshold v is feasible in H for the max- 
free expression Ei, then it is also feasible in G. Let Cp, . . . , C„ and C± , . . . , 
be the simple cycles of G and H respectively. We note that since DCSPAN(H) C 
DCSPAN{G), then for every convex combination x\, . . . ,x m , there is a convex 
combination yi, . . . , y n such that Y^TLi Xi^giCf 1 ) < X)"=i ViAvg{Cf) (in every 
dimension). Hence, a solution for the max-free constraints over graph H induces 
a solution for the max-free constraints over G (by replacing, in the inequalities 
of constraints [T] over graph H, the convex combination of cycles of H x%, . . . , x m 
with the convex combination of cycles of G yi, . . . , y n ). 

Thus, every threshold that is feasible for H is also feasible for G, and the 
proof follows. □ 

Lemma|5]gives rise to the notion of unsatisfactory weights vectors. For a given 
expression and threshold, a set of vectors V = {t>i, . . . , v n } is unsatisfactory if 
for every strongly connected graph G with simple cycles C\ , . . . , C n such that 
Avg(Ci) = Vi, and the threshold is infeasible in G. We note that by Lemma |6l 
a set of vectors V — {vi, . . . ,v n } is unsatisfactory if there exists a strongly 
connected graph G with simple cycles C%, . . . , C„ such that Avg(Ci) — Vi, we 
have that the threshold is infeasible in G. 

Similarly, when a multidimensional weighted graph G is given, we say that a 
set of simple cycles (of G) is unsatisfactory if the corresponding set of average 
weights is unsatisfactory. 

We will investigate games with winning objectives that are related to unsat- 
isfactory cycles in the next section. 



DCSPAN(Avg(Gj). Then: 



5 The Unsatisfactory Cycles Game 



The unsatisfactory cycles game (in short, UCG game) is played over a game 
graph G, a mean-payoff expression E and a threshold i/eQ, and player-1 is the 
winner of the game (from an initial vertex sq) if it has a finite- memory strategy 
a for which the set of reachable simple cycles in G a are unsatisfactory (with 
respect to E and v). 

We note that this game is not equivalent to the synthesis problem for mean- 
payoff expressions, as we do not require the cycles to be in one SCC. However, 
it is straight forward to see that a finite-memory winning strategy in the UCG 
game is a wining strategy for the mean-payoff expression game. 

In this section, we shall solve UCG games, that is, we will prove that there 
is an effective algorithm to compute the greatest lower bound on v for which 
player 1 is the winner in a UCG game (when G and E are given). Our solution 
relies on properties of the LSMMP games (which we defined in section [3]) and 
on properties of one-player mean-payoff expression games that we established in 
section SJ 

The key step of the solution is due to the next lemma. 

Lemma 7 Player 1 is the winner of the UCG game (G, sq, E,v) if and only if 
there exists a set of unsatisfactory (with respect to v) vectors V = {v\, . . . ,v n } 
(where n is the number of player- 2 memoryless strategies) such that 

For every player-2 memoryless strategy n, there exists a set of reachable 
connected simple cycles C Ti in G Ti , such that Vi £ relRatSPAN(C Ti ). 

Proof. We first prove the direction from left to right. Let a be a player-1 finite- 
memory winning strategy for the UCG game (G, sq, E, v), and let C = C\, . . . , C m 
be the set of reachable simple cycles in G a . By Lemma [TJ player 1 is the winner 
for the LSMMP game over {Avg(Ci), . . . , Avg(C n )}, and by Proposition [1] there 
exists a set of vectors V = {vi, . . . , v n } such that DCSPAN(C) D DCSPAN(V), 
and for every player-2 memoryless strategy Tj, there exists a set of reachable 
connected simple cycles C Ti in G Ti , such that v$ £ relRatSPAN(C Ti ). To com- 
plete the proof for the direction from left to right, we need to show that V is 
unsatisfactory. This follows from the fact that {Avg(Ci), . . . , Avg(C n )} in un- 
satisfactory (by definition), and since DCSPAN(C) D DCSPAN(V), then by 
Lemma [S] we get that V is also unsatisfactory. 

Conversely, if there exists a set V as stated, then by Proposition[T]there exists 
a player-1 finite-memory winning strategy a for the LSMMP game (G, sq,V). 
Let C = Ci, . . . , C m be the simple cycles in G a . By definition DCSPAN(C) C 
DCSPAN(V), and thus, by LemmaEl if V is unsatisfactory, then so is C. Thus, a 
is a winning strategy also for the UCG game (G, s , E, u), and the proof follows. 

□ 

We note that for a given graph, the number of player-2 memoryless strategies 
is finite, and if we fix a player-2 memoryless strategy, then the number of sets 
of reachable connected simple cycles is also finite. For a player-2 memoryless 



strategy r, let us denote by C T = {CJ, . . . ,C^} the set of all sets of reachable 
connected simple cycles in G T . To solve a UCG game, we should go over all 
the (finitely many) possible combinations of C%, . . . ,C n , such that for every i € 
{1, ... ,71} we have Ci € C Ti ; and check whether there are vectors v±, . . . ,v n such 
that (i) Vi 6 relRatSPAN (Ci) and (ii) ,u„ are unsatisfactory with respect 

to the expression and the threshold; and if such a combination and vector exist, 
then by Lemma [7J player 1 is the winner. 

Hence, in order to solve UCG games, we should solve the next problem: 

Problem 1 — Input: a graph (G, sq), an expression E = max(£'i, . . . , E m ) 
(where Ei is a max-free expression) , a threshold v, and n sets of reachable 
connected simple cycles C\ , . . . , C n . 
— Task: Decide if there are vectors v%, . . . ,v n> such that (i) for every Ei, the 
max-free constraints , when the average weights of the simple cycles are 
v\, . . . , v n , are infeasible with respect to threshold v; and (ii) Vi € relRatSPAN (Ci) 
for every i € {1, . . . ,n}. 

We note that we can formalize Problem Q] by a first-order formula over the 
domain of Reals and the dictionary (IsRational(-), +, x), where the predicate 
IsRational(-) consists of all rational numbers. The need for IsRational(-) arise 
from the requirement that i>j G relRatSPAN (Ci); to overcome this need, we 
consider a relaxed version of Problem]]] in which we require Vi € relSPAN(Ci) 
instead of e relRatSPAN (Ci). 

We denote by MT the greatest lower bound for the threshold v for which the 
answer to Problem Q] is YES, and we denote by RMT the corresponding value 
for the relaxed version of Problem [T] The next lemma states that both values 
are equal. 

Lemma 8 MT = RMT. 

Proof. Clearly, MT < RMT. In order to prove that MT > RMT, we define for 
every max-free expression Ei a function /j : R™ — ¥ R, such that fi (v 1 , i>2 , . . . , v n ) = 
r if r is the maximal threshold for which cycles with average weights v± , . . . , v n 
are satisfactory for Ei and r. It was established in [I] that /, is a continuous 
function, and thus we get that 



Since we can encode the relaxed version of Problem [T] by a first-order logic over 
Reals and (+, x) (also when v is a variable), then by Tarski's Theorem [4], the 
value of RMT is computable and hence, by Lemma [71 we get the main result of 
this section. 

Proposition 2 There exists an effective algorithm to compute the greatest lower 
bound on v for which player 1 is the winner in the UCG game (when E and G 
are given). 



inf 

Vi e relSPA N(Ci ) , . . . ,v„ € relSPAN (C„ ) 



fi(vi, ...,v n ) 



inf 

v 1 GrelRatSPAN(Ci),...,v n erelR,atSPAN(C n ) 



and the proof of the lemma is completed. 



□ 



6 The Synthesis Problem for Mean-Payoff Expressions 



In this section we consider a game (G, 8q, E, v), where G is a multidimensional 
game graph, sq is an initial vertex, E is a mean-payoff expression and v is a 
threshold. The objective of player 1 is to ensure, by a finite-memory strategy, 
a value of at most v for the expression. If such a finite-memory strategy exists, 
then we say the player 1 is the winner of (G, sq, E, v). 

The next observation describes the above synthesis problem in terms of un- 
satisfactory weight vectors. 

Observation 1 Player 1 is the winner of (G, s ,E, v) if and only if he a has a 
finite-memory strategy a such that the set of simple cycles of any reachable SCC 
in G a is unsatisfactory with respect to E and v. 

The winning region of player 1 is W\ = {s G S | player 1 is the winner of (G, s, E, 
that is, all vertices from which player 1 is the winner of the game. In order to 
solve the problem of whether player 1 is the winner, we compute the winning 
region W± , and check whether so € W\ . The next lemma gives a necessary and 
sufficient condition for the emptiness of the winning region. 

Lemma 9 Player- 1 winning region is nonempty if and only if there exists a 
vertex s such that player 1 is the winner in the UCG game (G, s, E, v). 

Proof. The direction from right to left is trivial. In order to prove the converse 
direction, we assume that player-1 winning region is not empty, and we denote 
by o = {M,ma,a u ,a n ) the player-1 finite-memory winning strategy for the 
mean-payoff expression game (G,q,E,v) (for some q € W\). We partition G a 
into strongly connected components, and observe that there is at least one end 
component EC. Let s a = (s, m) be a vertex in EC. Since the set of reachable cycles 
in £C (which is exactly the set of cycles in EC) is unsatisfactory (otherwise, a is 
not a winning strategy), we get that a' = (M,m,a u ,a n ) is a winning strategy 
for the UCG game (G, s, E, v), and the proof follows. □ 

Analogously to notion of winning regions, we define the notion of value region. 
The value region of a value r in a game is the set of all vertices s for which 
xnhiG,s,E < r. By Lemma [5] we get that the value region of a fixed r, for the 
mean-payoff expression game, is empty if and only if there exists a vertex s for 
which rniiiG, s.e < r in the corresponding UCG game. Hence, by Proposition [2] 
we obtain the next recursive algorithm for computing player-1 value regions: 

— If the input is an empty graph, then the value regions of all values are empty. 

— Compute minG, s ,_B in the UCG game, for every s € S, and let q be the vertex 
with the minimal such value, and let r be that value (the computation is 
possible by Proposition^ . Then Attr\ (q) is part of the value region of r (and 
any higher values) in the mean-payoff expression game, and we continue the 
computation, recursively, over the game graph G — Attr\ (q) . 

Hence, the main result of this paper follows. 



Theorem 1 There is an effective algorithm for the quantitative analysis of 
mean-payoff expression games, when player 1 is restricted to finite-memory strate- 
gies. 
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